Entertainment content ratings system based on physical expressions of a spectator to scenes of the content

ABSTRACT

A method for generating a rating of entertainment content is provided. The method includes receiving data from a monitoring device associated with a spectator, the monitoring device communicatively coupled to the computing system, wherein the data obtained by the monitoring device includes a physical expression of the spectator viewing the entertainment content, analyzing the physical expression of the spectator to obtain (i) an eyesight direction of the spectator, and (ii) a facial expression of the spectator, during a scene of the entertainment content, determining an emotional reaction of the spectator to the scene of the entertainment content based on the analyzing of the physical expression of the spectator, calculating an emotional ranking of the scene of the entertainment content based on the emotional reaction of the spectator to the scene, and providing the overall ranking of the entertainment content in view of an aggregate of emotional reactions of the spectator.

This application is a continuation application claiming priority to Ser.No. 15/358,191, filed Nov. 22, 2016.

BACKGROUND

The present invention relates to an entertainment content ratingssystem, and more specifically to monitoring physical reactions of aspectator. The entertainment industry uses ratings to evaluate a successof movies, television programs, and other entertainment content.Traditional methods for obtaining a rating of entertainment content arelimited to audience measurement systems that look at total audience,average age of audience member, household incomes, and otherdemographics based on a presumed view of the entertain content.

SUMMARY

An aspect of this invention relates to a method, and associated computersystem and computer program product, for generating a rating ofentertainment content. A processor of a computing system receives datafrom a monitoring device associated with a spectator, the monitoringdevice communicatively coupled to the computing system, wherein the dataobtained by the monitoring device includes a physical expression of thespectator viewing the entertainment content. The physical expression isanalyzed to obtain (i) an eyesight direction of the spectator, and (ii)a facial expression of the spectator, during a scene of theentertainment content. An emotional reaction of the spectator to thescene of the entertainment content is determined based on the analyzingof the physical expression of the spectator. An emotional ranking of thescene of the entertainment content is calculated based on the emotionalreaction of the spectator to the scene. The overall ranking of theentertainment content is provided, in view of an aggregate of emotionalreactions of the spectator.

The foregoing and other features of construction and operation will bemore readily understood and fully appreciated from the followingdetailed disclosure, taken in conjunction with accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

Some of the embodiments will be described in detail, with reference tothe following figures, wherein like designations denote like members,wherein:

FIG. 1 depicts a block diagram of an entertainment content ratingssystem, in accordance with embodiments of the present invention;

FIG. 2 depicts a block diagram of a monitoring device 110, which is partof the entertainment content ratings system of FIG. 1, in accordancewith embodiments of the present invention;

FIG. 3 depicts a perspective view of a monitoring device hick isdepicted as a block diagram in FIG. 2, which is part of theentertainment content ratings system depicted in FIG. 1, in accordancewith embodiments of the present invention;

FIG. 4 depicts a block diagram of an alternative embodiment of amonitoring device, in accordance with embodiments of the presentinvention;

FIG. 5 depicts a flow chart of a method for generating a rating ofentertainment content, in accordance with embodiments of the presentinvention;

FIG. 6 depicts a flowchart of a step of the method of FIG. 5 fordetermining spectator emotional response to a scene of a movie, inaccordance with embodiments of the present invention;

FIG. 7 illustrates a block diagram of a computer system for theentertainment content ratings system of FIG. 1, capable of implementingmethods for generating a rating of entertainment content of FIG. 5, inaccordance with embodiments of the present invention;

FIG. 8 depicts a cloud computing environment, in accordance withembodiments of the present invention; and

FIG. 9 depicts abstraction model layers, in accordance with embodimentsof the present invention.

DETAILED DESCRIPTION

Although certain embodiments are shown and described in detail, itshould be understood that various changes and modifications may be madewithout departing from the scope of the appended claims. The scope ofthe present disclosure will in no way be limited to the number ofconstituting components, the materials thereof, the shapes thereof, therelative arrangement thereof, etc., and are disclosed simply as anexample of embodiments of the present disclosure. A more completeunderstanding of the present embodiments and advantages thereof may beacquired by referring to the following description taken in conjunctionwith the accompanying drawings, in which like reference numbers indicatelike features.

As a preface to the detailed description, it should be noted that, asused in this specification and the appended claims, the singular forms“a”, “an” and “the” include plural referents, unless the context clearlydictates otherwise.

Current methods for obtaining ratings or rankings of entertain content,such as movies, television programs, live shows, films, motion pictures,etc. are limited to broad conclusions regarding an entire audience. Forexample, content is rated based on viewer recording what content theviewer has consumed, or by electronic meters that can detect contentbeing watched, downloaded, streamed, etc. However, these methods fallshort in many ways to produce an accurate rating. Self-reporting,diary-based review methods include response bias in the reporting andviewing of content. Electronically metering or tabulated consumedcontent over a network can be misleading because the viewer may not evenbe paying attention to the content while the content is being broadcast.The self-reporting method and electronic metering is not present inmovie theaters or live show theaters to receive feedback from thespectator. Further, no information about the viewer/spectator isobtained, and segments of the entertainment content are not reviewed orrated.

Thus, a need exists for an entertainment content ratings system andmethod that monitors and analyzes an emotional reaction of a spectatorto one or more scenes of the entertainment content to obtain an accurateranking of the entertainment content.

Referring to the drawings, FIG. 1 depicts a block diagram of anentertainment content ratings system 100, in accordance with embodimentsof the present invention. Embodiments of an entertainment contentratings system 100 may be described as a system for sentiment analyticsof spectators of entertainment content. Spectator sentiment or emotionalreaction to entertainment content, or to particular scenes ofentertainment content, may be used to generate an emotional ranking ofone or more scenes of the entertainment content. Based on an aggregateof emotional rankings, an overall rating or ranking of the content maybe provided. A spectator may be monitored, continuously or otherwise, toobtain instant feedback of the spectator's experience or reaction to ascene of a movie. For instance, a physical expression, such as aheartbeat or facial expression, may be captured by a monitoring devicewhen watching or otherwise consuming entertainment content. Themonitoring device may be glasses, such as 3D glasses handed out by amovie theater, that include various cameras, sensors, and the like, tocapture spectator data, such as a heartbeat or emotional expressions,during the movie. The reactions may be collected to analyze the audiencemembers' reactions, individually or as a whole, to various scenes,twists, character arcs, etc. By using the analysis of the collected dataof the spectator, the entertainment content ratings system 100 may rankthe entertainment content in terra of emotional responses. Additionally,by monitoring an eyesight direction of the spectator withcamera-equipped glasses, or other wearable technology, the entertainmentratings system 100 can determine an interest level of the spectator, aswell as which part of the movie screen commands the most attention fromthe spectator. In some cases, the combination of the emotional reactionand the location that the spectator is looking can be used to confirm toa director of the movie if a particular scene had a desired effect, andmay also provide useful insight into the spectator, such as theirpersonality, likes, dislikes, attitude, gender, and the like. A profilemay then be developed for a specific spectator for tailoringadvertisements, offers, promotions, etc.

Embodiment of entertainment content ratings system 100 may comprise amonitoring device 110 and input device 111 a, 111 b communicativelycoupled to a computing system 120 over a network 107. The number ofinput device 111 a, 111 b connecting to computer system 120 over network107 may vary from embodiment to embodiment. As shown in FIG. 1, themonitoring device 110 and/or the input device 111 a, 111 b may transmitdata about the spectator/viewer, such as physical movements, physicalexpressions, facial expressions, eyesight direction, physiological data(e.g. “spectator data”) received from the monitoring device 110 and/orinput device 111 a, 111 b by connecting to computing system 120 over thenetwork 107. A network 107 may refer to a group of two or more computersystems linked together. Network 107 may be any type of computer networkknown by individuals skilled in the art. Examples of computer networks107 may include a LAN, WAN, campus area networks (CAN), home areanetworks (HAN), metropolitan area networks (MAN), an enterprise network,cloud computing network (either physical or virtual) e.g. the Internet,a cellular communication network such as GSM or CDMA network or a mobilecommunications data network. The architecture of the computer network107 may be a peer-to-peer network in some embodiments, wherein in otherembodiments, the network 107 may be organized as a client/serverarchitecture.

In some embodiments, the network 107 may further comprise, in additionto the computer system 120, monitoring device 110 and input device 111a, 111 b, a connection to one or more network accessible knowledge basescontaining information of one or more users, network repositories 114 orother systems connected to the network 107 that may be considered nodesof the network 107. In some embodiments, where the computing system 120or network repositories 114 allocate resources to be used by the othernodes of the network 107, the computer system 120 and network repository114 may be referred to as servers.

The network repository 114 may be a data collection area on the network107 which may back up and save all the data transmitted back and forthbetween the nodes of the network 107. For example, the networkrepository 114 may be a data center saving and cataloging spectator datasent by the monitoring device 110 and/or input device 111 a, 111 b togenerate both historical and predictive reports regarding a particularspectator. In some embodiments, a data collection center housing thenetwork repository 114 may include an analytic module capable ofanalyzing each piece of data being stored by the network repository 114.Further, the computer system 120 may be integrated with or as a part ofthe data collection center housing the network repository 114. In somealternative embodiments, the network repository 114 may be a localrepository (not shown) that is connected to the computer system 120.

Referring still to FIG. 1, embodiments of the computing system 120 mayreceive the spectator data from the monitoring device 110 and/or inputdevice 111 a, 111 b which may be positioned within an environment sharedby the spectator, worn by the spectator, or otherwise disposed in alocation that can result in obtaining spectator data. Input device 111a, 111 b may be a sensor, an input device, or any input mechanism. Forexample, input devices 111 a, 111 b may be a biometric sensor, awearable sensor, an environmental sensor, a camera, a camcorder, amicrophone, a peripheral device, a computing device, a mobile computingdevice, such as a smartphone or tablet, facial recognition sensor, voicecapture device, and the like. Embodiments of input device 111 a, 111 bmay also include a heart rate monitor used to track a current orhistorical average heart rate of the spectator; wireless-enabledwearable technology, such as an activity tracker or smartwatch thattracks a heart rate; a blood pressure monitor; a perspiration sensor;and other wearable sensor hardware. Further embodiments of input device111 a, 111 b not specifically listed herein may be utilized to collectspectator data.

Further embodiments of input means 111 a, 111 b may include one or moreinput devices or input mechanisms, including one or more cameraspositioned proximate the spectator or within an environment shared bythe spectator. The one or more environment cameras may capture imagedata or video data of an spectator, including a posture, facialexpressions, perspiration, muscle activity, gestures, etc. Embodimentsof the input device 111 a, 111 b may also include one or moremicrophones positioned nearby the spectator to collect audio relating tothe spectator, and other hardware input devices, such as an audioconversion device, digital camera or camcorder, voice recognitiondevices, graphics tablet, a webcam, VR equipment, mouse, touchpad,stylus, and the like, which may help gauge a reaction by the spectatorto a scene of a movie. Further embodiments of input device 111 a, 111 bmay include a mobile computing device, such as a smartphone or tabletdevice, which may run various applications that contain data about thespectator. For example, a spectator's smartphone may be used as asensor, and may also utilize the device's camera, microphone, and otherembedded sensors to send information to the computing system 120.Moreover, embodiments of input device 111 a, 111 b may encompass otherinput mechanisms, such as a user computer that may send information tothe computing system 120, wherein the user computer may be loaded withsoftware programs that are designed to track an emotional output of thespectator.

FIG. 2 depicts a block diagram of a monitoring device 110, which is partof the entertainment content ratings system of FIG. 1, in accordancewith embodiments of the present invention. Embodiments of the monitoringdevice 110 may include hardware and software components. For instance,embodiments of the monitoring device 110 may include hardware componentssuch as a microcontroller 241, camera 210, sensor 211, network interfacecontroller 214, and an I/O interface 250. Software components of themonitoring device 110 may be located in a memory system 205 of themonitoring device 110. Embodiments of the monitoring device 110 mayinclude a microcontroller 241 for implementing the tasks associated withthe monitoring device 110. In an exemplary embodiment, the computingsystem 120 may receive the spectator data from the monitoring devicewhich may be worn by the spectator.

FIG. 3 depicts a perspective view of a monitoring device as depicted asa block diagram in FIG. 2, which is part of the entertainment contentratings system depicted in FIG. 1, in accordance with embodiments of thepresent invention. Embodiments of the monitoring device 110 may bewearable glasses, smart glasses, camera-equipped glasses, 3D movietheater glasses equipped with at least one camera, and the like.Embodiments of the monitoring device 110 may be wearable by thespectator while watching entertainment content. For example, thespectator may wear the monitoring device 110 while watching a movie at amovie theater. In movie theater embodiments, the movie theater may handout monitoring devices 110 (e.g. glasses) to the spectators beforeentering the theater to watch a movie. The monitoring device 110 mayalso have 3-dimensional viewing capabilities for movies offered in 3D.Alternative embodiments of the monitoring device 110 may be a smartbracelet, a smart watch, or other wearable accessories that may beequipped with the hardware and software associated with the monitoringdevice 110.

Referring again to FIG. 2, embodiments of the monitoring device may havea camera 210. Embodiments of the camera 210 may be a camera, an imagerecognition system, one or more cameras, and the like. The camera 210may be a lateral camera positioned on the glasses, so that the camera(s)may be lateral to the eye of the spectator, pointing laterally at theeye of the spectator. The camera 210 may capture, from the spectator, amovement of an eye, a movement of a nose, a movement of an eyebrow, amovement of a facial skin, a heartbeat, a movement of a pupil of theeye, a movement of an eyelid of the eye, and a movement of a lip. In anexemplary embodiment, the camera 210 of the monitoring device 210 maycapture at least half of an eye of the spectator, a portion of a nose ofthe spectator, and a portion of an eyebrow of the spectator. Due to theproximity of the camera 210 of the monitoring device 110, microexpressions of facial movement and expressions may be captured insufficient detail to be analyzed by the computing system 120 todetermine an emotional reaction of the spectator to the entertainmentcontent, or a specific scene of the content. Embodiments of the camera210, or a separate component of the monitoring device 110, may be animage recognition system capable of deducing an emotion based on a microexpression or movement of the eye of the spectator.

In addition, the camera(s) 210 of the monitoring device 110 may becapable of detecting an eyesight direction of the spectator as thespectator watches the entertainment content. The eyesight direction maybe determined by locating a position or angle position of the eye, orpupil/iris of the eye with respect to the monitoring device 110 or alens of the monitoring device 110. Sensor(s), such as sensor 211 of themonitoring device 110 may be used to determine a position andorientation of the monitoring device 110 (or a lens surface thereof) inphysical space. Exemplary embodiments of sensors 211 may include agyroscope and/or accelerometer, or other comparable sensors thatprovided information regarding an orientation of an object in physicalspace. With a known angle/position of the eyes with respect to themonitoring device 110, and orientation information of the monitoringdevice 110, an eyesight direction may be determined at any point (e.g.for a particular scene) during the entertainment content. The eyesightdirection of the spectator may indicate where the spectator is looking.For example, the eyesight direction may indicate whether the spectatoris looking away from the movie screen, looking down at a cell phone,looking to a side of the spectator to speak with a companion, etc.,which may allow the computing system 120 to conclude that the spectatoris either not looking at the entertainment content or is not interestedin the entertainment content at a particular point in the movie, orother content. Moreover, the eyesight direction obtained by themonitoring device 110 may be used to determine which area of the scenethat the spectator is watching. In other words, the eyesight directionmay indicate a segment of a display that the spectator is viewing duringa scene. This may allow computing system 120 to develop an understandingof a spectator's interest and emotional reaction to not only aparticular scene of the content, but a specific characteristic of thescene. For example, computing system 120 may receiveinformation/spectator data regarding which locations of a scene on thescreen are most interesting to the spectator, which actors/actresses arecommanding the spectator's attention in a scene, as well as how anindividual spectator visually tracks a scene of the content.

Accordingly, embodiments of the monitoring device 110 may capture orotherwise obtain spectator data, including an eyesight direction andphysical expressions, which may be used to generate a rating or rankingof the entertainment content, as described in greater detail infra.

In some embodiments, the sensor 211 of the monitoring device 110 may bean additional biometric sensor or physiological data collecting device,which may be mounted to, built-in, or otherwise coupled to themonitoring device 110. In one embodiment, sensor 211 may be a heart ratemonitor. In another embodiment, the sensor 211 may be a facialrecognition sensor. Embodiments of the monitoring device 110 may includea plurality of sensors 211 having various functions, such as a heartrate monitor, accelerometer, gyroscope, a heat sensor, a perspirationdetector, and the like.

Referring still to FIG. 2, embodiments of the monitoring device 110 mayinclude a network interface controller 214. Embodiments of the networkinterface controller 214 may be a hardware component of the monitoringdevice 110 that may connect the monitoring device 110 to network 107.The network interface controller may transmit and receive data,including the transmission of spectator data acquired, collected,captured, or otherwise obtained by the monitoring device 110. In someembodiments, the spectator data may be stored in storage device 225 ofmemory system 205 of the monitoring device 110. The network interfacecontroller 214 may access the storage device 225, and transmit thespectator data over the network 107 to the computing system 120.Additionally, embodiments of the monitoring device 110 may include anI/O interface 250. An I/O interface 250 may refer to any communicationprocess performed between the monitoring device 110 and the environmentoutside of the monitoring device 110. Input to the monitoring device 110may refer to the signals or instructions sent to the monitoring device110, for example data or meta data of the entertainment content that isloaded onto the monitoring device 110, while output may refer to thesignals sent out from the monitoring device 110.

Furthermore, embodiments of the memory system 205 of the monitoringdevice 110 may include a content retrieval module 231 and a data capturemodule 232. A “module” may refer to a hardware based module, softwarebased module or a module may be a combination of hardware and software.Embodiments of hardware based modules may include self-containedcomponents such as chipsets, specialized circuitry and one or morememory devices, while a software-based module may be part of a programcode or linked to the program code containing specific programmedinstructions, which may be loaded in the memory system 205 of themonitoring device 110. A module (whether hardware, software, or acombination thereof) may be designed to implement or execute one or moreparticular functions or routines.

Embodiments of the content retrieval module 231 may include one or morecomponents of hardware and/or software program code for retrievinginformation/data of the entertainment content to be viewed by thespectator. In an exemplary embodiment, the monitoring device 110 mayreceive information/data of the entertainment content, which may bestored in the storage device 225. In some embodiments, the data of amovie to be watched by the spectator may be loaded onto the monitoringdevice 110 via I/O interface 250 and stored on the storage device 225.In other embodiments, the data of the movie to be watched may bedownloaded via the network interface controller 214 and stored in thestorage device 225. Embodiments of the data of the entertainment contentmay be data or meta data associated with the entertainment content to beviewed by the spectator, which may include scene-specific information,timing information, synchronization information, identifyinginformation, director goals, movie studio company inserted queries, andthe like. In one example, the data may include a version of a movie thathas been previously tagged by a director of the movie so that one ormore, or each, scene may be linked to an emotion that the director wantsto elicit from or convey to the spectator. In another example, thecontent data may include a version of entertainment content thatincludes synchronization information so that the cameras 210 and sensors211 of the monitoring device 110 are synchronized with the content beingbroadcast, streamed, projected, or otherwise displayed on a displayscreen for the spectator's viewing. Thus, the content retrieval module231 may access the storage device 225 to obtain the content data, or mayaccess an entertainment content database 112 over the network 107 toretrieve the entertainment content database.

Moreover, embodiments of the monitoring device 110 may include a datacapture module 232. Embodiments of the data capture module 232 mayinclude one or more components of hardware and/or software program codefor capturing spectator data. The data capture module 232 may obtainspectator data from the hardware components of the monitoring device110. For example, the monitoring device 110 may utilize cameras andsensors to obtain physical expressions of the spectator, as describedabove. Embodiments of the data capture module 232 may be configured totransmit the spectator data to the computing system 120 via networkinterface controller 214 over the network 7.

Furthermore, embodiments of the monitoring device 110 worn by a firstspectator may be in communication with the input device 111 a, 111 b.The monitoring device 110 and the input device(s) 111 a, 111 b mayinteract with each other for collecting comprehensive, accurate, timely,and organized data, and sending to computing system 120. Additionally,the monitoring device 110 worn by the first spectator or the inputdevice 111 a, 111 b associated with the first spectator may communicatewith a monitoring device 110 worn by a second spectator and/or inputdevice 111 a, 111 b associated with the second spectator. A first devicemay request help from another device to confirm a physical expression ofthe spectator or a data result from another device. For example, afacial recognition sensor of the monitoring device 110 maycommunicatively interact with a heartrate monitor bracelet worn by thefirst spectator to confirm whether the spectator is indeed feelingscared, and may additionally communicate with a thermal sensor todetermine whether the spectator is possibly sweating based on atemperature of the spectator's environment crowded theater). Further,embodiments of the monitoring device 110 associated with the spectatormay be synchronized with other monitoring devices 110 associated withother spectators, or may be synchronized with input devices 111 a, 111 bassociated with the spectator to provide accurate and timely data incombination to the computing system 120, such that an audience as awhole may be measured, and may be classified into categories such asseat location (e.g. front row, back row, etc.) within the theater, todetermine whether scenes are more effective or reactive if experiencedup close, or may be used to further profile the spectators.

Referring back to FIG. 1, embodiments of the computing system 120 mayinclude a content processing module 131, a data receiving module 132, ananalytics module 133, and a ratings module 134. A “module” may refer toa hardware based module, software based module or a module may be acombination of hardware and software. Embodiments of hardware basedmodules may include self-contained components such as chipsets,specialized circuitry and one or more memory devices, while asoftware-based module may be part of a program code or linked to theprogram code containing specific programmed instructions, which may beloaded in the memory device of the computer system 120. A module(whether hardware, software, or a combination thereof) may be designedto implement or execute one or more particular functions or routines.

Embodiments of the content processing module 131 may include one or morecomponents of hardware and/or software program code for retrieving,obtaining, or otherwise receiving information/data of the entertainmentcontent to be viewed by the spectator. In an exemplary embodiment, thecomputing system 120 may receive information/data of the entertainmentcontent, which may be stored in the data repository 125. The data of themovie to be watched may be received from the entertainment contentdatabase 112. For example, the content processing module 131 may querythe entertainment content database 112 to receive necessary data or metadata associated with entertainment content viewed by the spectator.Embodiments of the entertainment content database 112 may includeentertainment content, such as movies, television programs, or othervideo content. The database 112 may be maintained or otherwisecontrolled/managed by a content distributor. The entertainment contentdatabase 112 may be queried by the content processing module 131 whenthe spectator data is received from the monitoring device 110 (or inputdevices 111 a, 111 b) or may be received prior to receiving spectatordata. Embodiments of the data of the entertainment content that isprovided to the computing system 120 may be data or meta data associatedwith the entertainment content to be viewed by the spectator, which mayinclude scene-specific information, timing information, synchronizationinformation, identifying information, director goals, movie studiocompany inserted queries, as described above. Thus, the contentprocessing module 131 may receive the entertainment content that isbeing viewed by the spectator wearing a monitoring device 110.

Embodiments of the computing system 120 may also include a datareceiving module 132. Embodiments of the data receiving module 132 mayinclude one or more components of hardware and/or software program codefor receiving spectator data from the monitoring device 110, and/or theinput device 111 a, 111 b. The data receiving module 132 may receivespectator data from the hardware components of the monitoring device110. For example, the monitoring device 110 may utilize cameras andsensors to obtain physical expressions of the spectator, as describedabove, the data of which may be transmitted to the computing system 120over the network 7. Embodiments of the data receiving module 132 mayorganize, classify, or otherwise categorize the spectator data as neededby the computing system 120.

Embodiments of the computing system 120 may further include an analyticsmodule 133 for analyzing spectator data and determining an emotionalresponse to a scene of entertainment content. Embodiments of theanalytics module 133 may refer to configurations of hardware, softwareprogram code, or combinations of hardware and software programs, capableof analyzing data received from the monitoring device 110 and/or inputdevice 111 a, 111 b and applying one or more data models to discover,identify, interpret and recognize the physical expression of thespectator. Embodiments of the physical expressions of the spectator mayinclude a movement of an eye, a movement of a nose, a movement of aneyebrow, a movement of a facial skin, a heartbeat, a movement of a pupilof the eye, a movement of an eyelid of the eye, and a movement of a lip,which can be detected by the monitoring device 110. For example,embodiments of the analytics module 133 may analyze the physicalexpressions of the spectator to obtain an eyesight direction of thespectator, and a facial expression of the spectator, during a scene ofthe entertainment content. The analytics module 133 may rely onapplications of statistics, computer programming, and the like, of thedata collected and received by the analytics module 133 in order todetermine the eyesight location and the facial expressions of thespectator. Embodiments of the analytics module 133 may analyze orotherwise interpret micro expressions of facial movement and otherphysical expressions that may be captured in sufficient detail by themonitoring device 110 to deduce the spectator data into facialexpressions and eyesight location to determine an emotional reaction ofthe spectator to the entertainment content, or a specific scene of thecontent. For instance, the analytics module 133 may analyze thespectator data relating to a position of the eyes of the spectator todetermine an eyesight location. The eyesight direction may be determinedby comparing a location, a position or angle of the eye, or pupil irisof the eye to a position of the monitoring device 110 or a lens of themonitoring device 110 and/or the location of the movie screen. Datareceived from sensor(s), of the monitoring device provide a position andorientation of the monitoring device 110 (or a lens surface thereof) inphysical space, which may be utilized by the analytics module 133 todetermine an eyesight location.

Further embodiments of the analytics module 133 may refer toconfigurations of hardware, software program code, or combinations ofhardware and software programs, capable of analyzing data received fromthe monitoring device 110 and/or input device 111 a, 111 b and applyingone or more data models to determine an emotional response of thespectator to a scene of the entertainment content. Embodiments of theanalytics module 133 may determine an emotional response to scene byanalyzing the facial expression and the eyesight location. As describedabove, the eyesight direction of the spectator may indicate where thespectator is looking, which may allow the analytics module 133 toconclude that the spectator is either not looking at the entertainmentcontent or is not interested in the entertainment content at aparticular point in the movie, or other content. In other words, theanalytics module 133 may confirm that the spectator is watching theentertainment content, and is interested in the content, based on theeyesight location. Once confirmed that the spectator is watching, theanalytics module 133 may determine an emotional response or emotionalreaction using the facial expressions derived by the analytics module133 from the physical expressions obtained by the monitoring device 110.Embodiments of the analytics module 133 may examine the facialexpression to determine an emotion of the spectator, while the spectatoris viewing a particular scene of the content. Examining facialexpressions may focus on one or more zones of the spectator's eyes. Aplurality of emotions can be deduced from the facial expression data byanalyzing, examining, or otherwise interpreting, by the analytics module133, the micro expressions, physical expressions, and other movement ofthe spectator's eyes, nose, cheek, skin, eyebrow, and other facialfeatures. As an example, the following emotions can be deduced by thecomputing system 120 as follows:

-   -   Surprise: the eyebrows are raised and curved and the skin below        is stretched. The eyelid is opened with the white of the eye        showing above and below the iris. When the eyes are wide open,        the spectator experiences true surprise;    -   Fear: the eyebrows are drawn together like they were a flat        line. The upper eyelid is raised, the lower is drawn up and        tense. The white of the eye is showing only above the iris, not        below and this particular alone is sufficient to distinguish        surprise from fear.    -   Sadness: inner corners of the eyebrows are drawn in and then up.        The skin below the eyebrows triangulated with inner corner up.        This micro expression is the hardest to fake. Sadness can also        be determined if the eyes are dry or watery as if the spectator        is going to cry.    -   Happiness: a wrinkle runs from outer nose to outer lip when the        cheeks are raised. The lower lid may show wrinkles or be tense.        To be sure that is true happiness, the side eye muscles should        be engaged by forming crow's feet near the outside of the eyes.    -   Disgust: the eyelids are raised like the cheeks and wrinkles        appear on the nose. Lines show below the lower lid. In order to        distinguish disgust from happiness, the system can trace the        eyebrows, if they are drawn together cannot surely be happiness,        and no participation of the side eye muscles.    -   Anger: the eyebrows are lowered and drawn together. Lower lid is        tense, the eyes stare or are bulging. This micro expression also        needs the layout of the nose and of the jaw, yet the system can        safely assume the spectator is feeling anger when this pattern        appears on his or her face.

Other emotions may be detected or determined by the analytics module133. Further, the above listed emotions may be detected using othertechniques, rules, information, etc. A degree of emotion may also bedetermined by the analytics module 133. For instance, if a scene made auser smile, then the analytics module 134 may determine that thespectator's emotional response/reaction was happy. However, in someembodiments, if the spectator smiled very wide, laughed for a longduration, laughed out loud, etc., the analytics module 134 may determinethat the scene is funnier and made the spectator happier than otherscenes that may have also resulted in the spectator's emotional reactionbeing happy. Accordingly, embodiments of the analytics module 134 may beable to determine a degree or scale of emotion, based on the detectionof the spectators' physical expressions.

Moreover, the eyesight direction obtained by the monitoring device 110may be used to determine which area of the scene that the spectatorwatching. In other words, the analytics module 133 may analyze theeyesight direction to determine a segment of a display/screen that thespectator is viewing during a scene. This may allow computing system 120to develop an understanding of a spectator's interest and emotionalreaction to not only a particular scene of the content, but a specificcharacteristic of the scene. For example, the analytics module 133 mayreceive information/spectator data regarding which locations of a sceneon the screen are most interesting to the spectator, whichactors/actresses are commanding the spectator's attention in a scene, aswell as how an individual spectator visually tracks a scene of thecontent.

With continued reference to FIG. 1, embodiments of the computing system120 may include a ratings module 134. Embodiments of the ratings module134 may include one or more components of hardware and/or softwareprogram code for calculating an emotional ranking of the spectator inresponse to a particular scene of the entertainment content. Forinstance, embodiments of the ratings module 134 may rank or rate aparticular scene of the entertainment content based on the determinedemotional reaction of the spectator. Each scene may be linked orotherwise associated with the emotional reaction of the spectator. Inone embodiment, a scene that made the spectator cry may be rated as asad scene of the entertainment content. In another embodiment, a scenethat made the spectator laugh may be rated or ranked as a funny scene ofthe entertainment content. In each embodiment, the scenes of theentertainment content may be ranked or rated based on the emotion of thespectator. The ratings module 134 may also use the degree of emotionalreaction to rate or rank a scene. If a first scene made the spectatorscared, and a second scene made the spectator even more scared based onthe spectator's physical expressions to the first scene and the secondscene, the ratings module 134 may calculate a lower emotional ranking(scary) of the first scene than the emotional ranking (scary) of thesecond scene. In some embodiments, the ratings module 134 may use ascale or a spectrum of emotions to rate or rank a scene. For example,the ratings module 134 may rank a scene that made a spectator smile as a1 on funny scale, but rank a scene that made the spectator laugh out andloud and turn to the spectator's companion and laugh with them a 10(e.g. which may be captured by the monitoring device 110, such as withan outward facing camera that captures a reaction of the rest of theaudience or a person sitting next to the spectator). The ratings module134 may incorporate a separate scale or spectrum for each emotion, orhave mixed emotional scale to rank or rate an emotional reaction to aparticular scene.

Furthermore, embodiments of the ratings module 134 may rate or rank anemotional reaction of the spectator to a particular scene for multiplepurposes. In one embodiment, the ratings module 134 may provide instantfeedback about the movie based on the emotional reactions to thespectators to determine whether a particular scene was indeed funny orscary. In another embodiment, the ratings module 134 may confirm adirector's intent to make a particular scene scary or sad, which may beused as a tool for studio's to evaluate the director of the content. Inyet another embodiment, the ratings module 134 may be used as aninformation gathering tool for obtaining personal information about thespectator, such as their personality, interests, temperament, emotionalquotient, level of intelligence, sophistication, and the like.

This information may be used to tailor advertisements, offers,promotions, emails, etc. based on the spectator's emotional reaction toa particular scene. For example, the ratings module 134 (or other moduleof computing system 120) may create a profile of the spectator using theemotional reactions of the spectator. Embodiments of the ratings module134 may access the spectator profile, which may categorize or catalogthe spectator by age, sex, languages spoken, nationality, interest,emotional quotients, personality, likes, dislikes etc., and offerdiscounts or deals for movie tickets that are more likely to be takenadvantage of by the spectator.

Moreover, embodiments of the ratings module 134 may also determine whichportion or area of the scene drew the most attention of the spectator.For example, embodiments of the rating module 134 may augment or modifya rating of a scene that has a significant percentage of spectator'slooking at a particular part of the scene. Further, the ratings module134 may use the information regarding which area of the scene was mostviewed to determine whether a particular directing technique worked orfailed, which actor or actress commands the scene, and the like, all ofwhich may be used for evaluation methods.

Further embodiments of the ratings module 134 may include one or morecomponents of hardware and/or software program code for providing anoverall rating of the entertainment content. Embodiments of the ratingsmodule 134 may combine each ranking of the emotional reaction of thespectator to determine an overall rating of the entertainment content.Embodiments of the overall rating may be a numerical value, a textconclusion, a graphical representation of interest of the spectator asthe movie progressed, a diagram of ell emotions evoked, and the like.The overall rating may also determine whether the entertainment contentwas as funny as promoted, scary as advertised, etc. Further, the overallrating may be used to determine whether the entertainment content issuccessful, well-appreciated, disliked, unmoving, boring, intense, etc.,which is based on emotional reactions of the spectators. Embodiments ofthe ratings module 134 may provide the overall ranking of theentertainment content in view of an aggregate of emotional reactions ofthe spectator. Even further, embodiments of the ratings module 134 mayprovide the overall ranking of the entertainment content view of anaggregate of emotional reactions of the entire audience in a theater, oreach showing of content in a theater for a day, week, month, or formultiple theaters in one or more geographical locations. For instance,at the end of the movie, the ratings module 134 may provide an overallrating of the movie based on the aggregate emotional rankings of thespectator, but may also provide reports with other types of data andstatistics, such as where geographically the content has been moreappreciated, an age range of spectators that liked or disliked themovie, gender statistics, and the like. Embodiments of the ratingsmodule 134 may provide a report or notify a third party of the resultsof the ratings for evaluation and the like.

Referring still to FIG. 1, embodiments of the computer system 120 may beequipped with a memory device 142 which may store the spectator data,emotional reactions/responses, scene ratings, entertainment contentratings, and the like, and a processor 141 for implementing the tasksassociated with the entertainment content rating system 100.

FIG. 4 depicts a block diagram of an alternative embodiment of amonitoring device 110, in accordance with embodiments of the presentinvention. Alternative embodiment of monitoring device 110 may performthe tasks associated with the analytics module 133 and the ratingsmodule 134. For instance, rather than transmitting the spectator data tothe computing system 120, embodiments of the monitoring device 110 mayinclude a computing system capable of processing the spectator data andanalyzing the spectator data to create a rating of entertainmentcontent, in accordance with embodiments of the present invention. Theratings results may be transmitted to a remote server from themonitoring device 110.

Referring now to FIG. 5, which depicts a flow chart of a method 300 forgenerating a rating of entertainment content, in accordance withembodiments of the present invention. One embodiment of a method 300 oralgorithm that may be implemented for generating a rating ofentertainment content in accordance with the entertainment contentratings system 100 described in FIGS. 1-4 using one or more computersystems as defined generically in FIG. 6 below, and more specifically bythe specific embodiments of FIGS. 1-4.

Embodiments of the method 300 for generating a rating of entertainmentcontent may begin at step 301 wherein the entertainment content to beviewed by the spectator is received by the computing system 120. Thecontent may be accessed over the network 107 from the entertainmentcontent database 112, and may be synchronized with the content loaded onthe monitoring device 110, so that the spectator's wearable monitoringdevice 110 provides accurate spectator data. Step 302 receives spectatordata obtained by the monitoring device 110 and/or input device 111 a,111 b. The spectator data may include various data regarding thespectator, including physical expressions of the spectator in responseto viewing content. Step 303 analyzes the spectator data to obtain oneor more facial expressions and/or an eyesight direction. In particular,the physical expressions of the spectator are analyzed to obtain the oneor more facial expressions and/or the eyesight direction. Step 304determines an emotional reaction or response of the spectator inresponse to a particular scene, using the facial expression and eyesightlocation.

FIG. 6 depicts a flowchart of a step of the method of FIG. 5 fordetermining spectator emotional response to a scene of a movie, inaccordance with embodiments of the present invention. Step 401 analyzesthe physical expression to obtain eyesight direction and facialexpression of the spectator. Step 402 confirms that the spectator isinterested or at least looking at the content being displayed, bydetermining whether the eyesight direction indicates that the spectatoris looking at the content or not. If the spectator is not looking or isnot interested in the content, then step 403 concludes that thespectator is not interested or not looking, and resumes analysis ofadditionally received spectator data. If the spectator is looking at thecontent, then step 404 uses the eyesight direction to determine whicharea of the scene the spectator is looking at during the scene. Then,step 405 examines the facial expression of the spectator in response toa particular scene. Step 406 classifies an emotion associated with thefacial expression. For example, the emotion associated with a particularfacial expression is determined and linked with the particular scene.Step 407 then determines an emotional response or emotional ranking ofthe scene based on the spectator's emotional response to the scene.

Referring back to FIG. 5, step 305 calculates an emotional ranking orrating of the scene of the entertainment content. For instance, anemotional ranking or rating a particular scene of the entertainmentcontent based on the determined emotional reaction of the spectator.Each scene may be linked or otherwise associated with the emotionalreaction of the spectator. Step 306 provides an overall rating of theentertainment content, which may be provided in view of an aggregate ofemotional reactions of the spectator to multiple scenes of the content.

FIG. 7 illustrates a block diagram of a computer system 500 that may beincluded in the system of FIGS. 1-3 and for implementing the methods ofFIGS. 4-6 in accordance with the embodiments of the present disclosure.The computer system 500 may generally comprise a processor 591, an inputdevice 592 coupled to the processor 591, an output device 593 coupled tothe processor 591, and memory devices 594 and 595 each coupled to theprocessor 591. The input device 592, output device 593 and memorydevices 594, 595 may each be coupled to the processor 591 via a bus.Processor 591 may perform computations and control the functions ofcomputer 500, including executing instructions included in the computercode 597 for the tools and programs capable of implementing a method forgenerating a rating of entertainment content, in the manner prescribedby the embodiments of FIGS. 3-5 using the entertainment content ratingssystem FIGS. 4-5, wherein the instructions of the computer code 597 maybe executed by processor 591 via memory device 595. The computer code597 may include software or program instructions that may implement oneor more algorithms for implementing the methods of for generating arating of entertainment content, as described in detail above. Theprocessor 591 executes the computer code 597. Processor 591 may includea single processing unit, or may be distributed across one or moreprocessing units in one or more locations (e.g., on a client andserver).

The memory device 594 may include input data 596. The input data 596includes any inputs required by the computer code 597. The output device593 displays output from the computer code 597. Either or both memorydevices 594 and 595 may be used as a computer usable storage medium (orprogram storage device) having a computer readable program embodiedtherein and/or having other data stored therein, wherein the computerreadable program comprises the computer code 597. Generally, a computerprogram product (or, alternatively, an article of manufacture) of thecomputer system 500 may comprise said computer usable storage medium (orsaid program storage device).

Memory devices 594, 595 include any known computer readable storagemedium, including those described in detail below. In one embodiment,cache memory elements of memory devices 594, 595 may provide temporarystorage of at least some program code (e.g., computer code 597) in orderto reduce the number of times code must be retrieved from bulk storagewhile instructions of the computer code 597 are executed. Moreover,similar to processor 591, memory devices 594, 595 may reside at a singlephysical location, including one or more types of data storage, or bedistributed across a plurality of physical systems in various forms.Further, memory devices 594. 595 can include data distributed across,for example, a local area network (LAN) or a wide area network (WAN).Further, memory devices 594, 595 may include an operating system (notshown) and may include other systems not shown in FIG. 6.

In some embodiments, the computer system 500 may further be coupled toan Input/output (I/O) interface and a computer data storage unit. An I/Ointerface may include any system for exchanging information to or froman input device 592 or output device 593. The input device 592 may be,inter alia, a keyboard, a mouse, etc. or in some embodiments the sensors110. The output device 593 may be, inter alia, a printer, a plotter, adisplay device (such as a computer screen), a magnetic tape, a removablehard disk, a floppy disk, etc. The memory devices 594 and 595 may be,inter alia, a hard disk, a floppy disk, a magnetic tape, an opticalstorage such as a compact disc (CD) or a digital video disc (DVD), adynamic random access memory (DRAM), a read-only memory (ROM), etc. Thebus may provide a communication link between each of the components incomputer 500, and may include any type of transmission link, includingelectrical, optical, wireless, etc.

An I/O interface may allow computer system 500 to store information(e.g., data or program instructions such as program code 597) on andretrieve the information from computer data storage unit (not shown).Computer data storage unit includes a known computer-readable storagemedium, which is described below. In one embodiment, computer datastorage unit may be a non-volatile data storage device, such as amagnetic disk drive (i.e., hard disk drive) or an optical disc drive(e.g., a CD-ROM drive which receives a CD-ROM disk). In otherembodiments, the data storage unit may include a knowledge base or datarepository 125 as shown in FIG. 1.

As will be appreciated by one skilled in the art, in a first embodiment,the present invention may be a method; in a second embodiment, thepresent invention may be a system; and in a third embodiment, thepresent invention may be a computer program product. Any of thecomponents of the embodiments of the present invention can be deployed,managed, serviced, etc. by a service provider that offers to deploy orintegrate computing infrastructure with respect to content ratingsystems and methods. Thus, an embodiment of the present inventiondiscloses a process for supporting computer infrastructure, where theprocess includes providing at least one support service for at least oneof integrating, hosting, maintaining and deploying computer-readablecode (e.g., program code 597) in a computer system (e.g., computer 500)including one or more processor(s) 591, wherein the processor(s) carryout instructions contained in the computer code 597 causing the computersystem to provide a rating of entertainment content. Another embodimentdiscloses a process for supporting computer infrastructure, where theprocess includes integrating computer-readable program code into acomputer system including a processor.

The step of integrating includes storing the program code in acomputer-readable storage device of the computer system through use ofthe processor. The program code, upon being executed by the processor,implements a method for generating a rating of entertainment content.Thus, the present invention discloses a process for supporting,deploying and/or integrating computer infrastructure, integrating,hosting, maintaining, and deploying computer-readable code into thecomputer system 500, wherein the code in combination with the computersystem 500 is capable of performing a method for generating a rating ofentertainment content.

A computer program product of the present invention comprises one ormore computer readable hardware storage devices having computer readableprogram code stored therein, said program code containing instructionsexecutable by one or more processors of a computer system to implementthe methods of the present invention.

A computer system of the present invention comprises one or moreprocessors, one or more memories, and one or more computer readablehardware storage devices, said one or more hardware storage devicescontaining program code executable by the one or more processors via theone or more memories to implement the methods of the present invention.

The present invention may be a system, a method, and/or a computerprogram product at any possible technical detail level of integration.The computer program product may include a computer readable storagemedium (or media) having computer readable program instructions thereonfor causing a processor to carry out aspects of the present invention.

The computer readable storage medium can be a tangible device that canretain and store instructions for use by an instruction executiondevice. The computer readable storage medium may be, for example, but isnot limited to, an electronic storage device, a magnetic storage device,an optical storage device, an electromagnetic storage device, asemiconductor storage device, or any suitable combination of theforegoing. A non-exhaustive list of more specific examples of thecomputer readable storage medium includes the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a static random access memory (SRAM), a portablecompact disc read-only memory (CD-ROM), a digital versatile disk (DVD),a memory stick, a floppy disk, a mechanically encoded device such aspunch-cards or raised structures in a groove having instructionsrecorded thereon, and any suitable combination of the foregoing. Acomputer readable storage medium, as used herein, is not to be construedas being transitory signals per se, such as radio waves or other freelypropagating electromagnetic waves, electromagnetic waves propagatingthrough a waveguide or other transmission media (e.g., light pulsespassing through a fiber-optic cable), or electrical signals transmittedthrough a wire.

Computer readable program instructions described herein can bedownloaded to respective computing/processing devices from a computerreadable storage medium or to an external computer or external storagedevice via a network, for example, the Internet, a local area network, awide area network and/or a wireless network. The network may comprisecopper transmission cables, optical transmission fibers, wirelesstransmission, routers, firewalls, switches, gateway computers and/oredge servers. A network adapter card or network interface in eachcomputing/processing device receives computer readable programinstructions from the network and forwards the computer readable programinstructions for storage in a computer readable storage medium withinthe respective computing/processing device.

Computer readable program instructions for carrying out operations ofthe present invention may be assembler instructions,instruction-set-architecture (ISA) instructions, machine instructions,machine dependent instructions, microcode, firmware instructions,state-setting data, configuration data for integrated circuitry, oreither source code or object code written in any combination of one ormore programming languages, including an object oriented programminglanguage such as Smalltalk, C++, or the like, and procedural programminglanguages, such as the “C” programming language or similar programminglanguages. The computer readable program instructions may executeentirely on the user's computer, partly on the user's computer, as astand-alone software package, partly on the user's computer and partlyon a remote computer or entirely on the remote computer or server. Inthe latter scenario, the remote computer may be connected to the user'scomputer through any type of network, including a local area network(LAN) or a wide area network (WAN), or the connection may be made to anexternal computer (for example, through the Internet using an InternetService Provider). In some embodiments, electronic circuitry including,for example, programmable logic circuitry, field-programmable gatearrays (FPGA), or programmable logic arrays (PLA) may execute thecomputer readable program instructions by utilizing state information ofthe computer readable program instructions to personalize the electroniccircuitry, in order to perform aspects of the present invention.

Aspects of the present invention are described herein with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems), and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer readable program instructions.

These computer readable program instructions may be provided to aprocessor of a general purpose computer, special purpose computer, orother programmable data processing apparatus to produce a machine, suchthat the instructions, which execute via the processor of the computeror other programmable data processing apparatus, create means forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks. These computer readable program instructionsmay also be stored in a computer readable storage medium that can directa computer, a programmable data processing apparatus, and/or otherdevices to function in a particular manner, such that the computerreadable storage medium having instructions stored therein comprises anarticle of manufacture including instructions which implement aspects ofthe function/act specified in the flowchart and/or block diagram blockor blocks.

The computer readable program instructions may also be loaded onto acomputer, other programmable data processing apparatus, or other deviceto cause a series of operational steps to be performed on the computer,other programmable apparatus or other device to produce a computerimplemented process, such that the instructions which execute on thecomputer, other programmable apparatus, or other device implement thefunctions/acts specified in the flowchart and/or block diagram block orblocks.

The flowchart and block diagrams in the Figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods, and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof instructions, which comprises one or more executable instructions forimplementing the specified logical function(s). In some alternativeimplementations, the functions noted in the blocks may occur out of theorder noted in the Figures. For example, two blocks shown in successionmay, in fact, be executed substantially concurrently, or the blocks maysometimes be executed in the reverse order, depending upon thefunctionality involved. It will also be noted that each block of theblock diagrams and/or flowchart illustration, and combinations of blocksin the block diagrams and/or flowchart illustration, can be implementedby special purpose hardware-based systems that perform the specifiedfunctions or acts or carry out combinations of special purpose hardwareand computer instructions.

It is to be understood that although this disclosure includes a detaileddescription on cloud computing, implementation of the teachings recitedherein are not limited to a cloud computing environment. Rather,embodiments of the present invention are capable of being implemented inconjunction with any other type of computing environment now known orlater developed.

Cloud computing is a model of service delivery for enabling convenient,on-demand network access to a shared pool of configurable computingresources (e.g., networks, network bandwidth, servers, processing,memory, storage, applications, virtual machines, and services) that canbe rapidly provisioned and released with minimal management effort orinteraction with a provider of the service. This cloud model may includeat least five characteristics, at least three service models, and atleast four deployment models.

Characteristics are as follows:

On-demand self service: a cloud consumer can unilaterally provisioncomputing capabilities, such as server time and network storage, asneeded automatically without requiring human interaction with theservice's provider.

Broad network access: capabilities are available over a network andaccessed through standard mechanisms that promote use by heterogeneousthin or thick client platforms (e.g., mobile phones, laptops, and PDAs).

Resource pooling: the provider's computing resources are pooled to servemultiple consumers using a multi-tenant model, with different physicaland virtual resources dynamically assigned and reassigned according todemand. There is a sense of location independence in that the consumergenerally has no control or knowledge over the exact location of theprovided resources but may be able to specify location at a higher levelof abstraction (e.g., country, state, or datacenter).

Rapid elasticity: capabilities can be rapidly and elasticallyprovisioned, in some cases automatically, to quickly scale out andrapidly released to quickly scale in. To the consumer, the capabilitiesavailable for provisioning often appear to be unlimited and can bepurchased in any quantity at any time.

Measured service: cloud systems automatically control and optimizeresource use by leveraging a metering capability at some level ofabstraction appropriate to the type of service (e.g., storage,processing, bandwidth, and active user accounts). Resource usage can bemonitored, controlled, and reported, providing transparency for both theprovider and consumer of the utilized service.

Service Models are as follows:

Software as a Service (SaaS): the capability provided to the consumer isto use the provider's applications running on a cloud infrastructure.The applications are accessible from various client devices through athin client interface such as a web browser (e.g., web-based e-mail).The consumer does not manage or control the underlying cloudinfrastructure including network, servers, operating systems, storage,or even individual application capabilities, with the possible exceptionof limited user-specific application configuration settings.

Platform as a Service (PaaS): the capability provided to the consumer isto deploy onto the cloud infrastructure consumer-created or acquiredapplications created using programming languages and tools supported bythe provider. The consumer does not manage or control the underlyingcloud infrastructure including networks, servers, operating systems, orstorage, but has control over the deployed applications and possiblyapplication hosting environment configurations.

Infrastructure as a Service (IaaS): the capability provided to theconsumer is to provision processing, storage, networks, and otherfundamental computing resources where the consumer is able to deploy andrun arbitrary software, which can include operating systems andapplications. The consumer does not manage or control the underlyingcloud infrastructure but has control over operating systems, storage,deployed applications, and possibly limited control of select networkingcomponents (e.g., host firewalls).

Deployment Models areas follows:

Private cloud: the cloud infrastructure is operated solely for anorganization. It may be managed by the organization or a third party andmay exist on-premises or off-premises.

Community cloud: the cloud infrastructure is shared by severalorganizations and supports a specific community that has shared concerns(e.g., mission, security requirements, policy, and complianceconsiderations). It may be managed by the organizations or a third partyand may exist on-premises or off-premises.

Public cloud: the cloud infrastructure is made available to the generalpublic or a large industry group and is owned by an organization sellingcloud services.

Hybrid cloud: the cloud infrastructure is a composition of two or moreclouds (private, community, or public) that remain unique entities butare bound together by standardized or proprietary technology thatenables data and application portability (e.g., cloud bursting forload-balancing between clouds).

A cloud computing environment is service oriented with a focus onstatelessness, low coupling, modularity, and semantic interoperability.At the heart of cloud computing is an infrastructure that includes anetwork of interconnected nodes.

Referring now to FIG. 8, illustrative cloud computing environment 50 isdepicted. As shown, cloud computing environment 50 includes one or morecloud computing nodes 10 with which local computing devices used bycloud consumers, such as, for example, personal digital assistant (PDA)or cellular telephone 54A, desktop computer 54B, laptop computer 54C,and/or automobile computer system 54N may communicate. Nodes 10 maycommunicate with one another. They may be grouped (not shown) physicallyor virtually, in one or more networks, such as Private, Community,Public, or Hybrid clouds as described hereinabove, or a combinationthereof. This allows cloud computing environment 50 to offerinfrastructure, platforms and/or software as services for which a cloudconsumer does not need to maintain resources on a local computingdevice. It is understood that the types of computing devices 54A, 4B,54C and 54N shown in FIG. 8 are intended to be illustrative only andthat computing nodes 10 and cloud computing environment 50 cancommunicate with any type of computerized device over any type ofnetwork and/or network addressable connection (e.g., using a webbrowser).

Referring now to FIG. 9, a set of functional abstraction layers providedby cloud computing environment 50 (see FIG. 8) is shown. It should beunderstood in advance that the components, layers, and functions shownin FIG. 8 are intended to be illustrative only and embodiments of theinvention are not limited thereto. As depicted, the following layers andcorresponding functions are provided:

Hardware and software layer 60 includes hardware and softwarecomponents. Examples of hardware components include: mainframes 61; RISC(Reduced Instruction Set Computer) architecture based servers 62;servers 63; blade servers 64; storage devices 65; and networks andnetworking components 66. In some embodiments, software componentsinclude network application server software 67 and database software 68.

Virtualization layer 70 provides an abstraction layer from which thefollowing examples of virtual entities may be provided: virtual servers71; virtual storage 72; virtual networks 73, including virtual privatenetworks; virtual applications and operating systems 74; and virtualclients 75.

In one example, management layer 80 may provide the functions describedbelow. Resource provisioning 81 provides dynamic procurement ofcomputing resources and other resources that are utilized to performtasks within the cloud computing environment. Metering and Pricing 82provide cost tracking as resources are utilized within the cloudcomputing environment, and billing or invoicing for consumption of theseresources. In one example, these resources may include applicationsoftware licenses. Security provides identity verification for cloudconsumers and tasks, as well as protection for data and other resources.User portal 83 provides access to the cloud computing environment forconsumers and system administrators. Service level management 84provides cloud computing resource allocation and management such thatrequired service levels are met. Service Level Agreement (SLA) planningand fulfillment 85 provide pre-arrangement for, and procurement of,cloud computing resources for which a future requirement is anticipatedin accordance with an SLA.

Workloads layer 90 provides examples of functionality for which thecloud computing environment may be utilized. Examples of workloads andfunctions which maybe provided from this layer include: mapping andnavigation 91; software development and lifecycle management 92; virtualclassroom education delivery 93; data analytics processing 94;transaction processing 95; and ratings generation for entertainmentcontent 96.

While embodiments of the present invention have been described hereinfor purposes of illustration, many modifications and changes will becomeapparent to those skilled in the art. Accordingly, the appended claimsare intended to encompass all such modifications and changes as fallwithin the true spirit and scope of this invention.

The descriptions of the various embodiments of the present inventionhave been presented for purposes of illustration, but are not intendedto be exhaustive or limited to the embodiments disclosed. Manymodifications and variations will be apparent to those of ordinary skillin the art without departing from the scope and spirit of the describedembodiments. The terminology used herein was chosen to best explain theprinciples of the embodiments, the practical application or technicalimprovement over technologies found in the marketplace, or to enableothers of ordinary skill in the art to understand the embodimentsdisclosed herein

1. A method for generating an overall rating of entertainment content,the method comprising: retrieving, by a processor of a wearablemonitoring device, metadata of the entertainment content to be viewed bythe spectator, the metadata including synchronization information, sothat a lateral camera and at least one sensor of the wearable monitoringdevice are synchronized with the entertainment content to be viewed bythe spectator; detecting, by the processor, a physical expression of aspectator viewing the entertainment content, the physical expressioncaptured by a lateral camera of the wearable monitoring device, thelateral camera being positioned laterally to an eye of the spectatorsuch that the lateral camera captures at leak half of an eye of thespectator, a portion of a nose of the spectator, and a portion of aneyebrow of the spectator, from a side of the spectator, wherein, as afunction of the detecting the physical expression, an eyesight directionof the spectator, and a facial expression of the spectator, during ascene of the entertainment content, is obtained; and sending, by theprocessor, data associated with the physical expression of the spectatorto a computing system to: (i) determine an emotional reaction of thespectator the scene of the entertainment content, (ii) calculate anemotional ranking of the scene of the entertainment content based on theemotional reaction of the spectator to the scene, and (iii) providingthe overall ranking of the entertainment content in view of an aggregateof emotional reactions of the spectator.
 2. The method of claim 1,wherein the physical expression of the spectator includes a movement ofan eye, a movement of a nose, a movement of an eyebrow, a movement of afacial skin, a heartbeat, a movement of a pupil of the eye, a movementof an eyelid of the eye, and a movement of a lip.
 3. The method of claim1, wherein the monitoring device includes a network interface controllerto download the metadata.
 4. The method of claim 1, wherein the at leastone sensor is selected from the group consisting of a biometric sensor,a heartrate sensor, a facial recognition sensor, accelerometer,gyroscope, and perspiration detector.
 5. The method of claim 1, whereinthe computing system determines the emotional reaction of the spectatorby confirming that the spectator is interested in the scene of the moviebased on the eyesight direction of the spectator, and examining thefacial expression of the spectator to determine a micro-expression ofthe spectator that is associated with at least one emotion.
 6. Themethod of claim 5, wherein the eyesight direction confirms the interestof the spectator in the scene of the movie, and the eyesight directionis also used to determine which area of the scene commands the mostattention of the spectator.
 7. The method of claim 1, wherein themonitoring device is a wearable pair of glasses, the wearable pair ofglasses having an image recognition system.
 8. A wearable monitoringsystem, comprising: a processor; a memory device coupled to theprocessor; a computer readable storage device coupled to theprocessor,herein the storage device contains program code executable bythe processor via the memory device to implement a method for generatingan overall rating of entertainment content, the method comprising:retrieving, by the processor, metadata of the entertainment content tobe viewed by the spectator, the metadata including synchronizationinformation, so that a lateral camera and at least one sensor of thewearable monitoring device are synchronized with the entertainmentcontent to be viewed by the spectator; detecting, by the processor, aphysical expression of a spectator viewing the entertainment content,the physical expression captured by a lateral camera of the wearablemonitoring device, the lateral camera being positioned laterally to aneye of the spectator such that the lateral camera captures at least halfof an eye of the spectator, a portion of a nose of the spectator, and aportion of an eyebrow of the spectator, from a side of the spectator,wherein, as a function of the detecting the physical expression, aneyesight direction of the spectator, and a facial expression of thespectator, during a scene of the entertainment content, is obtained; andsending, by the processor, data associated with the physical expressionof the spectator to a computing system to: (i) determine an emotionalreaction of the spectator to the scene of the entertainment content,(ii) calculate an emotional ranking of the scene of the entertainmentcontent based on the emotional reaction of the spectator to the scene,and (iii) providing the overall ranking of the entertainment content inview of an aggregate of emotional reactions of the spectator.
 9. Thewearable monitoring system of claim 8, wherein the physical expressionof the spectator includes a movement of an eye, a movement of a nose, amovement of an eyebrow, a movement of a facial skin, a heartbeat, amovement of a pupil of the eye, a movement of an eyelid of the eye, anda movement of a lip.
 10. The wearable monitoring system of claim 8,wherein the monitoring device includes a network interface controller todownload the metadata.
 11. The wearable monitoring system of claim 8,wherein the at least one sensor is selected from the group consistingof: a biometric sensor, a heartrate sensor, a facial recognition sensor,accelerometer, gyroscope, and perspiration detector.
 12. The wearablemonitoring system of claim 8, wherein the computing system determinesthe emotional reaction of the spectator by confirming that the spectatoris interested in the scene of the movie based on the eyesight directionof the spectator, and examining the facial expression of the spectatorto determine a micro-expression of the spectator that is associated withat least one emotion.
 13. The wearable monitoring system of claim 12,wherein the eyesight direction confirms the interest of the spectator inthe scene of the movie, and the eyesight direction is also used todetermine which area of the scene commands the most attention of thespectator.
 14. The wearable monitoring system of claim 8, wherein themonitoring device is a wearable pair of glasses, the wearable pair ofglasses having an image recognition system.
 15. A computer programproduct, comprising a computer readable hardware storage device storinga computer readable program code, the computer readable program codecomprising an algorithm that when executed by a computer processor of awearable monitoring system implements a method for generating an overallrating of entertainment content, comprising: retrieving, by theprocessor, metadata of the entertainment content to be viewed by thespectator, the metadata including synchronization information, so that alateral camera and at least one sensor of the wearable monitoring deviceare synchronized with the entertainment content to be viewed by thespectator; detecting, by the processor, a physical expression of aspectator viewing the entertainment content, the physical expressioncaptured by a lateral camera of the wearable monitoring device, thelateral camera being positioned laterally to an eye of the spectatorsuch that the lateral camera captures at least half of an eye of thespectator, a portion of a nose of the spectator, and a portion of aneyebrow of the spectator, from a side of the spectator, wherein, as afunction of the detecting the physical expression, an eyesight directionof the spectator, and a facial expression of the spectator, during ascene of the entertainment content, is obtained; and sending, by theprocessor, data associated with the physical expression of the spectatorto a computing system to: (i) determine an emotional reaction of thespectator the scene of the entertainment content, (ii) calculate anemotional ranking of the scene of the entertainment content based on theemotional reaction of the spectator to the scene, and (iii) providingthe overall ranking of the entertainment content in view of an aggregateof emotional reactions of the spectator
 16. The computer program productof claim 15, wherein the physical expression of the spectator includes amovement of an eye, a movement of a nose, a movement of an eyebrow, amovement of a facial skin, a heartbeat, a movement of a pupil of theeye, a movement of an eyelid of the eye, and a movement of a lip. 17.The computer program product of claim 15, wherein the at least onesensor is selected from the group consisting of: a biometric sensor, aheartrate sensor, a facial recognition sensor, accelerometer, gyroscope,and perspiration detector.
 18. The computer program product of claim 15,wherein the computing system determines the emotional reaction of thespectator by confirming that the spectator is interested in the scene ofthe movie based on the eyesight direction of the spectator, andexamining the facial expression of the spectator to determine amicro-expression of the spectator that is associated with at least oneemotion.
 19. The computer program product of claim 18, wherein theeyesight direction confirms the interest of the spectator in the sceneof the movie, and the eyesight direction is also used to determine whicharea of the scene commands the most attention of the spectator.
 20. Thecomputer program product of claim 15, wherein the monitoring device is awearable pair of glasses, the wearable pair of glasses having an imagerecognition system.